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Objective 

To assess the likelihood of biased trials contained in 12 
recently published meta-analyses. 

Design 

A review of component randomised controlled trials of 
systematic reviews with 12 meta analyses. 

Data sources 

12 recently published systematic reviews with 503 compo- 
nent randomised trials, which were published in the BMJ, 
Lancet, JAMA and The Annals of Internal Medicine up 
until May 2012. 

Eligibility criteria for selecting studies 

Systematic reviews were eligible for inclusion if they 
included only randomised controlled trials (RCTs). We 
obtained the full text for the component RCTs of the 
12 systematic reviews. We excluded RCTs which were 
not available in English from our review and analysis. 


Conclusions 

The majority of a sample of recent meta-analyses 
showed that there were signs of imbalance and or 
heterogeneity in ages between treatment groups, when 
there should have been none. Systematic reviewers 
might consider using the techniques described here to 
assess the validity of their findings. 
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Results 

Five of the 12 meta-analyses exhibited heterogeneity 
(I >0.30) in age differences, when there should have been 
none, with two having significant or substantial heteroge- 
neity (I^ > 0.50). In three meta-analyses we found that the 
age of intervention group was statistically significantly 
higher than in the control group. Two meta-analysis had a 
distribution of p-values that were inconsistent with 
chance. Meta-regression explained some of the observed 
heterogeneity in two meta-analyses as a consequence of 
poor allocation concealment. 
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